Connectivity driven Coherence in Complex Networks 
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We study the emergence of coherence in complex networks of mutually coupled non-identical ele- 
ments. We uncover the precise dependence of the dynamical coherence on the network connectivity, 
on the isolated dynamics of the elements and the coupling function. These findings predict that 
in random graphs, the enhancement of coherence is inversely proportional to the mean degree. In 
locally connected networks, coherence is no longer controlled by the mean degree, but rather on how 
the mean degree scales with the network size. In these networks, even when the coherence is absent, 
adding a fraction s of random connections leads to an enhancement of coherence proportional to 1/s. 
Our results provide a way to control the emergent properties by the manipulation of the dynamics 
of the elements and the network connectivity. 



Among the large variety of dynamical phenomena ob- 
served in complex networks, collective behavior is ubiqui- 
tous and has proven to be essential to the network func- 
tion [THH]. During the last decades, our understanding 
of collective behavior of complex networks has increased 
significantly. Most research focuses on synchronization 
of diffusively coupled of periodic elements with distinct 
frequencies [5HTT] and identical chaotic elements [121 [13] ■ 

In nature the interacting elements in complex networks 
are non-identical, in such situations complete synchro- 
nization is no longer possible, but a highly coherent state 
can be observed. Examples include collections of cou- 
pled maps [13] , power grid networks [5] , superconducting 
Joseph junctions [9], and brain networks [IHZj. In these 
systems, coherence is characterized by the mean field con- 
trolling the behavior of the nodes. Of major importance 
is how the coherence properties of a general collection 
of non-identical nodes depends on the structural param- 
eters of the network, on the coupling function, and on 
the node dynamics. Recent work has elucidated how the 
dynamics of the nodes can influence coherence in terms 
of mean field approximations for coupled maps [13] , con- 
struction of a Lyapunov function [IS] , and extending the 
Lyapunov exponents approach [1^1 HZ]. Moreover, con- 
trol techniques have also been used [HI [19] . Although, 
this problem has received increasing attention, the effect 
of network connectivity on the coherent systemic behav- 
ior still remains elusive. 

In this letter, we uncover how the dynamical coher- 
ence of the network depends on the node dynamics, the 
coupling function, and the network connectivity. Our 
approach is fully analytical and holds for a class of in- 
teraction functions whose Jacobian has positive real part 
spectrum. We find that in purely random network, co- 
herence is controlled by the mean degree. In locally con- 
nected networks, the mean degree no longer determines 
coherence, instead coherence is determined by an inter- 
play between the network size and degree of the nodes. 
If the mean degree scales properly with the network size, 
coherence emerges as the network grows. In these net- 
works, even if coherence is absent, by adding random 



connections we can induce coherence. 

The dynamics of a network of N coupled elements with 
interaction akin to diffusion is described by 
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dt 
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where fi : M™ — > M™ is smooth and governs the dynamics 
of the isolated nodes. H : M™ — > M™ is a smooth cou- 
pling function, a is the overall coupling strength, Aij = 1 
if nodes i and j are connected and Aij — otherwise. 
The degree, that is, the number of connections, of the 
ith node is given by ki = Aij . In this model, coher- 
ence is related to the Laplacian L where Lij = Sij ki — Aij 
and Sij is the Kronecker delta symbol. 

We assume that the coupling function possesses the 
following properties: i) H{0) = 0, ii) the Jacobian of 
the coupling function DH(0) = T has spectrum on the 
right part of the complex plane. Throughout the paper, 
/3 > denotes the smallest real part of the eigenvalues 
of r. The hypothesis on the spectrum of the Jacobian 
guarantees the stability of the problem, and cannot be 
omitted, otherwise, instabilities could appear due to an 
interplay between the dynamics of the individual nodes 
and the coupling function. Here, the norm || • || denotes 
the maximum norm. 

Main result: We consider fi = f + Pi, where < 
6/2 uniformly for all nodes We call S the hetero- 

geneity parameter. Our main finding is that, for large 
times, fluctuations of the trajectories are bounded by 
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\\x,it) - x,{t)\\ < — (2) 

apA2 — etc 

where S measures the heterogeneity among the node dy- 
namics, K — K(T) is a constant, a is the interaction 
strength, Uc = ac{f,H) is positive if the isolated dy- 
namics is chaotic, otherwise ac = 0, and A2 = A2(i) 
is the spectral gap, i.e., the second smallest eigenvalue 
of the Laplacian matrix L. Roughly speaking, our as- 
sumptions will guarantee that the coherence of the set of 
non-identical nodes is determined by the synchronization 
properties of the system of identical nodes 5 = 0. 
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A network of identical nodes: The situation of zero 
heterogeneity 6 = was studied in great detail in the 
past decades in terms of the master stability function 
[T^ . Here, we develop a theory based on dichotomies 
[5T], and their persistence. This allows us to develop 
a complete analytical treatment of the problem. The 
fully synchronized state a;i = • • • = a;„ is invariant un- 
der the equation of motion for all values of the cou- 
pling strength a, and it is called the synchronization 
manifold. To study the stability we expand the cou- 
pling function about the synchronization manifold, which 



yields H{xj — Xi 



T{xj — Xi) + r{xj — Xi), where 
r is a nonlinear Taylor remainder. We use the follow- 
ing convenient notation, denote X = col(a;i,--- ,a;„), 
here col stands for the vector formed by stacking the col- 
umn vectors Xi into a single column vector, note that 
X e E^". Similarly F{X) = col(/(a^i), • • • ,/(a;„)). 
Let (g) denote the tensor product. The dynamics of a 
network of identical nodes can be represented in tensor 
form as X' = F{X) - a{L (g) T)X + Rh, where Rh is 
the Taylor remainder from the coupling function. 

The vector 1 = (1, 1, • • • , l)/y/N, is an eigenvector of 
the Laplacian associated with the zero eigenvalue. More- 
over, since the eigenvectors of L are orthogonal, we con- 
sider the following decomposition X = 1 (E) s + ^, where 
^ does not lie in the span of 1 (g) s. Note that if ^ is 
zero, then the system is fully synchronized. The vari- 
ational equation governing the ^ reads as ^' = K{t)^, 
with K{t) = In ® Df{s{t)) — aL (g) T, where we ne- 
glected the nonlinear terms. The unique solution of this 
equation can be represented in terms of the evolution 
operator ^{t) = T{t, s)^(s). We postpone some technical 
manipulations [22] and present the main result concern- 
ing the contraction properties of the evolution operator 
\\T{t,s)\\ < Kexp{-[al3X2 - ac]{t - s)} for any t > s, 
where K = K{T) is a constant independent of the net- 
work, a is the coupling strength, /3 > is the smallest 
eigenvalue of F, and A2 is the spectral gap of the Lapla- 
cian. Here, ac = ac{f,H), and is positive if the node 
dynamics / has positive Lyapunov exponents. Note that 
since the contraction of the evolution operator is uniform 
the nonlinear remainders will not effect the stability of 
the transient towards synchronization. This finding im- 
plies that starting at a time s with nearby initial con- 
ditions we obtain \\xj{t) - x^{t)\\ < C'e-f"'^^^-"'^)'*-"). 
for all t > s. Therefore, the characteristic decay time is 
l/[af3X2 — ac\- Next, we show that the characteristic time 
controls the coherence of the heterogeneous network. 

Effect of the Heterogeneity: We consider Eq. ([l]) with 
node dependent maps fi. Again, we represent the equa- 
tions in the tensor representation, and perform the same 
decomposition as before X = 1 (g s + ^. The equation 
of motion can now be written as X' = F(X) ~ a{L ^ 
T)X + P{X) + RniO, P = col (pi,--- ,p„), hence 
||P(X)|| < 5 is a measure of the maximal heterogeneity 
across the nodes. We project the equation onto the syn- 



chronization manifold and to the orthogonal complement. 
The first projection gives us an equation for \ ® s and 
the second an equation for perturbations ^. After some 
manipulations, the equation for the perturbations reads 
I' = K{t)$, + G{X), where G{X) is the projection of P, 
Rh and Rp onto the orthogonal complement of the syn- 
chronization manifold. Here, Rp is the Taylor remainder 
of the vector field F about the synchronization manifold. 
By the method of variation of parameters the solution be- 
comes i{t) = r(t, 0)^(0) + SlT{t,u)G{X{u))du. Then, 
using the bounds on the norm of the evolution operator 
together with the triangular inequality for large times we 
obtain \\$,{t)\\ < (5/(2[a/3A2 - ad), and Eq. ^ follows. 

We use Eq. ([2| to study the effect of network connec- 
tivity. To this end, we measure the macroscopic coher- 
ence in the network by introducing the quantity 



E(t) 



N{N-1) 
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which quantifies the average distance between the trajec- 
tories of the nodes: the closer they are, the more coherent 
the system is, making E{t) smaller. The mean field dom- 
inates the dynamics of the individual nodes. From Eq. 
([2]) we obtain E{t) < 6/{aj3\2 — occ)- The denominator 
must be positive, so if ac > and A2 — >• as iV — 00, we 
can loose coherence at a finite network size. To illustrate 
these findings, we show that in a 2k nearest neighbor net- 
work there is a critical number of neighbors as a function 
of the network size N for the transition to coherence. 

For concreteness, we explore these findings using the 
Lorenz equation exhibiting a chaotic dynamics |23j to 
represent the node dynamics. Using the notation Xi = 
{xi,yi, Zi)* , where * denotes the transpose, the vector 
field reads f{x) = {<j{y — x),x{r — z) — y, —bz + xy)* , we 
choose the classical parameter values ct = 10, r = 28, b = 
8/3. We consider the non-identical behavior as a mis- 
match in the parameter a. Hence, each Lorenz system 
has ai = o'+Q, where Q is a random number picked inde- 
pendently according to a uniform distribution with sup- 
port [-e,e], yielding Pi{xi) = {Q{yi - a;i),0,0)*. Hence, 
< Afe, where M is such that |x—y I < M, for the 
Lorenz M « 40. Note that with this choice the hetero- 
geneity is (5 = 2M£. For simplicity we choose H{x) = x. 
We fix the coupling strength a = 10. The trajectories 
of the Lorenz accumulate in a neighborhood of a chaotic 
attractor, and hence, ac > |24| . For our numerical sim- 
ulations, we used the 4th order Runge-Kutta integration 
scheme with integration step lO^"'. 

Locally Connected Networks: Consider a network of 
N nodes, in which each node is coupled to its 2k near- 
est neighbors. The network Laplacian can be diago- 
nalized and the spectral gap explicitly obtained A2 = 
2k+l-si-a[{2k + l)TT/N]/ s\a{-K/N) (8j. We analyze fc as 
a function of the network size N as k = \N'' /2'] - where 
\x~\ is the largest integer that approximates x. It follows 
that there exists a critical number of neighbors needed 
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for the network to self organize towards coherence, that 
is, there is a critical 7c such that for 7 > 7c there is a 
transition to self organization and coherence is enhanced 
as the network size increases: the heterogeneity is sup- 
pressed and the mean field dominates the dynamics. In 
contrast, for 7 < 7c coherence is absent. The value of 7c 
for onset of coherence can be predicted by analyzing the 
zero of the denominator of Eq. For k <$:. N we ob- 
tain, up to the leading order in N, the following equation 
for the critical value of 7c: 



log (g) 

log TV 



(4) 



We check these predictions against the numerical sim- 
ulations for the Lorenz dynamics. We consider e = 0.2, 
and for each fixed system size N considering k = \N'>' /2] , 
we vary 7 and measure E{t), see Eq. The value of 
7c is determined by observing the behavior of E. Typ- 
ically, i? sa 45 before the transition to coherence, and 
after the transition E « 10""'^. Since, the transition from 
an incoherent to a coherent state is sharp, we can eas- 
ily detect the value of 7c. This numerical determination 
of 7c is presented as open circles in Fig. [ij against the 
theoretical prediction presented as a solid line. Likewise, 
for a fixed 7 we can vary the system size and determine 
the transition in E. Again, we find the critical network 
size as a function of 7. In the inset a) of Fig. [l] we ex- 
hibit a case where we fixed 7 = 0.3 and varied the system 
size. A sharp transition towards loss of coherence can be 
observed for iV = 40. 

If the isolated dynamics has = 0, then there is 
no abrupt transition towards coherence. Either an en- 
hancement of coherence for 7 > 7c, or a deterioration for 
7 < 7c. An example of this situation is observed in the 
standard Lotka-Volterra model. The state vector x of 
the model is two dimensional, and the vector field reads 
f{x) = {x[a — by],y[—d + cx])*. This system has a con- 
stant of motion, which means that Uc = 0. For simplicity 
we consider all parameters equal to 1 and mismatches in 
the parameter a as = a + Q, which Q as before. In 
our simulations on 2k nearest neighbor network, we fixed 
£ — 0.2, 7 = 0.3 and vary the network size N. We 
present the results in the inset b) of Fig. [l] We observed 
no abrupt transition to loss of coherence, in agreement 
with our predictions. The Kuramoto model is another 
relevant example of a node dynamics with ckc = 0. 

Small World graphs: Enhancing Collective Motion. 
Starting from a nearest neighbor network where no coher- 
ence is observed, we can enhance coherence by adding in 
a small fraction of random links. We add sN edges picked 
at random from the remaining unconnected pairs, so that 
the average number of shortcuts per node is s. This new 
network is called small world. A perturbation theory al- 
lows to estimate the expected values of the Laplacian 
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FIG. 1: 7c as a function of the network size A'^ for k — \N~' /2] . 
We fixed a — 10 and e — 0.2, and recall /? = 1. The open 
circles represent the numerical determination of 7c, and the 
solid line is the theoretical prediction, obtained solving a/3A2 — 
ac — for 7. The inset a) shows the critical behavior of 
E{t) for 7 = 0.3 as a function of the network size. Here at 
the critical network size A'^ = 44 coherence is lost, agreeing 
with the theoretical predictions. Inset b) we present the same 
numerical simulations for the Lotka-Volterra model. As we 
predict no abrupt transition is observed once ac = 0. 



spectral gap. Computing the eigenvalues of the Lapla- 
cian perturbatively reveals that for 1/3 < 7 < 1, also 
considering ^ 1, we obtain that A2 = 2s + 0{N^~^) 
is the expected value of the eigenvalue. As before, the 
denominator of Eq. ([2| must be positive, and this pro- 
vides a critical number of shortcuts Sc that must be added 
to obtain coherence. If s is larger then Sc we undergo a 
transition to onset of coherence and, up to high order cor- 
rections in the system size, where the coherent measure is 
given hy E{t) oc S/s. We check this prediction against nu- 
merical simulations using the Lorenz dynamics to model 
the nodes. Starting from the nearest neighbor network 
of size N = 1000 and 7 = 0.3 (no coherence is observed), 
we add a fraction of s random edges. We then vary s 
and measure the coherence. The result can be observed 
in the inset Fig. [2] b) . The theoretical prediction is in 
excellent agreement with our simulations of the Lorenz 
dynamics. Thus, by adding a small fraction of random 
connections we induce coherence. Here, the enhancement 
of coherence is inversely proportional to the fraction of 
random shortcuts s. 

Random Networks: As we discussed in the previous 
paragraph random structures can enhance coherence. In 
purely random networks, the coherence is inversely pro- 
portional to the mean degree. We use a random graph 
model G{w) for a sequence of expected degrees w — 
{wi,W2, ■ ■ ■ ,Wn). Each element of the adjacency A^^'s 
is an independent Bernoulli variable, taking value 1 with 
success probability pij = WiWjp, where p = J2^=i'^i- 
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The sequence must satisfy the condition wf < p to as- 
sure that pij < 1. Under these constructions Wi is the 
expected value of ki. The mean degree m — \/{Np) 
determines the spectral gap A2. 

The Erdos-Renyi random graphs correspond to the 
constant case Wi = pN. If p is constant then A2 is heavily 
concentrated at m. The power law graphs correspond to 
the case, w, cx r^/^^-i), with 0>2. See Ref. [15] for de- 
tails on this choice oi w'^s. The parameter 9 characterizes 
the degree distribution, that is, the probability P{k) to 
find a degree between k and k -\- Ak, behaves as a power 
law P{k) oc k~^ . If the network is large, the spectral gap 
A2 is heavily concentrated at m(l — l/{9 — 1)), see Ref. 
[13]. In these cases, for large mean degrees m, we obtain 
the scaling E (x S/m. 
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FIG. 2: Randomness enhance coherence: Log-Log plot of co- 
herence E versus the mean degree m for distinct random 
graphs. In a) for a fixed value a — 10 and A'' — 3000, we 
simulate the Lorenz dynamics on Erdos-Renyi with e = 1 
(□), Power law networks with — 3 and e = 1 (o). Then 
with £ = 0.2 for 6 = 2.7 (o) and 61 = 4 (A). In inset of a) 
starting from a 2k nearest neighbor network of size A*' — 1000 
and 7 = 0.3 no coherence is observed. We then add a fraction 
of s random links. This induces coherence in the network ac- 
cording to iJ cx In b) we depict the the mean field for 
the m = 2 and e = 1.0 for the Erdos-Renyi (black) and for 
the Power law network (light grey). 

We constructed these random networks with size N — 
3000 and studied numerically the coherence properties 
as a function of the mean degree m and heterogeneity 
d = 2Me. Our numerical simulations using the Lorenz 
dynamics yield E cx 6/m~^, in excellent agreement with 
our predictions, see Fig. [2] a). As coherence sets in the 
node dynamics is dominated by the mean field given 

by = J2f=i ^j/^- For fixed values of a = 10, e = 1.0 
and TO = 2, starting the nodes with almost the same ini- 



tial conditions, difference in norm between pair of nodes 
is 0.01, we show two distinct time series for for the 
Erdos-Renyi Network (black) and for the power law net- 
work with /? = 3 (light grey). Although, the isolated 
dynamics of the nodes can be significantly different the 
network achieves a highly coherent behavior. Fig. |2]6). 

In summary, we have uncovered the dependence of net- 
work coherence on the dynamics of the nodes, the net- 
work connectivity and the coupling function. In random 
networks, dynamical coherence is enhanced with the in- 
crease of the mean degree. These networks exhibit high 
connectivity and a small world property. In regular net- 
works the mean degree no longer controls the emergence 
and enhancement of coherence, rather we encounter a 
critical behavior: if the mean degree scales properly with 
the system size coherence emerges. We were able to de- 
termine such critical behavior analytically. In our numer- 
ical illustrations, we chose the non-indentical part Pi as 
a mismatch component. Our approach is general and Pi 
can be an essentially different system, or a noise driven 
component. In such networks even if coherence is absent, 
coherence can be induced by adding a vanishing fraction 
of random links. Formula ^ explains how the connectiv- 
ity can enhance coherence, which can be useful for many 
applied areas where coherence plays a fundamental role 
such power grid networks and neuroscience. 
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